A Patch Rectification Strategy for Multi-homography Estimation

In this work, we describe how to recover the perspective functions induced by the dominant faces of a rigid polyhedral scene captured by two cameras at different positions. The faces of any polyhedron can be dealt with as if they were planar surfaces, therefore we analyze this problem in a multi-planar scene context. We assume that the scene is populated with polyhedral objects and that a regular grid is imposed on the reference image. We describe a robust strategy that is able to merge patches that belong to the same planar surface and to impose the epipolar geometry constraints to the recovered perspective functions.